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Abstract 



o 

(N 

Oh 

r^ • We prove a Chevet type inequality which gives an upper bound 

Cd . for the norm of an isotropic log-concave unconditional random matrix 

in terms of expectation of the supremum of "symmetric exponential" 
processes compared to the Gaussian ones in the Chevet inequality. 
This is used to give sharp upper estimate for a quantity Tk,m that 
^ I controls uniformly the Euclidean operator norm of the sub-matrices 

vQ I with k rows and m columns of an isotropic log-concave unconditional 

^^ ■ random matrix. We apply these estimates to give a sharp bound for 

''^ , the Restricted Isometry Constant of a random matrix with indepen- 

C^ I dent log-concave unconditional rows. We show also that our Chevet 

^-^ ■ type inequality does not extend to general isotropic log-concave ran- 

dom matrices. 

rs : 1 Introduction 

Let n, N be positive integers. Let K C M^ and L C M" be origin symmetric 
convex bodies, || ■ \\k and || ■ H^, be the corresponding gauges on M^ and M", 
that is the norms for which K and L are the unit balls. 
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To shorten the notation we write ||r : K -^ L\\ for the operator norm of a 
hnear operator T : (M^, || ■ \\k) -^ (K", || • IU)- In particular, \\T : K -^ B^\\ 
will denote the operator norm of F considered as a linear operator from 
(M^, II ■ \\k) to £^, where £^ is M^ equipped with the canonical Euclidean 
norm, whose unit ball is B^; similarly for ||r : BJ} — )■ L||. Note also that 
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k) rnay be identified (via 
K°), where K° denotes the polar 



the dual normed space i^jr , h ■ \\k) 

the canonical inner product) with 

of K (see the next section for all definitions). The canonical basis on W^ is 

denoted by {ei}i<i<d. 



Let {g^ 



J j l<i<max {n,N) 



be i.i.d. standard Gaussian random variables that is 



centered Gaussian variables with variance 1, and F be a Gaussian matrix 
whose entries are i.i.d. standard Gaussian. Then one side of the Chevet 
inequality ([6], see also [^ for sharper constants) states that 



E||F : K ^ L\\< C\\ld : K -^ B^\\ ■ E 



+ C||Id: BJ} ^ L\\ -E 



n 

N 



(1) 



K° 



where Id stays for the formal identity operator and C is an absolute constant. 
This inequality plays an important role in Probability in Banach Spaces and 
in Asymptotic Geometric Analysis (|H [15]). 

We say that a random matrix F = {'jij) is isotropic if all entries [jij) 
are uncorrelated centered with variance one and it is log-concave if the joint 
distribution of the ■ji/s has a density which is log-concave on its support, 
finally we say that the matrix F is unconditional if for any choice of signs 



(ej-j) the matrices F and 



.^ij'l'ij. 



have the same distribution. There are similar 



definitions for random vectors. 

In Theorem 13.11 we prove that an inequality similar to the Chevet in- 
equality (II]) holds for any isotropic log-concave unconditional random matrix 
F when substituting the Gaussian random variables gt^s by i.i.d. random vari- 
ables with symmetric exponential distribution with variance 1. Moreover, in 
Corollary 13.21 we provide the corresponding probability estimates. 

A result from [S] of the second named author of this article states that 
if X = {Xi, . . . ,Xii) is an isotropic log-concave unconditional random vec- 
tor in M'^ and ii Y = {Ei, . . . , Ed), where Ei, . . . ,Ed are i.i.d. symmetric 
exponential random variables, then for any norm || ■ || on W^, one has 



E||X|| <CE||r||, (2) 

where C is an absolute constant. 

The proof of our Chevet type inequahty consists of two steps. First, us- 
ing the comparison ([2]), we reduce the case of a general isotropic log-concave 
unconditional random matrix A to the case of an exponential random ma- 
trix, i.e. the matrix whose entries are i.i.d. standard symmetric exponential 
random variables. The second step uses Talagrand's result ([13]) on relations 
between some random processes associated to the symmetric exponential 
distribution and so-called jp functional. 

We apply our inequality of Chevet type to obtain sharp uniform bounds 
on norms of sub-matrices of isotropic log-concave unconditional random ma- 
trices r. More precisely, for any subsets J C {1, . . . ,n} and / C {1, . . . , N} 
denote the submatrix of F consisting of the rows indexed by elements from 
J and the columns indexed by elements from / by F( J, /). Given k < n and 
m < N define the parameter F^ ,„ by 

Ffc,^ = sup||F(J,/) : i^^i'^l 

where the supremum is taken over all subsets J C {l,...,n} and / C 
{1, . . . , A^} with cardinalities \J\ = k, \I\ = m. That is, F^ ,„ is the maximal 
operator norm of a sub-matrix of F with k rows and m columns. We prove 
that 

r.,™ < C (^v^log (^) + v^log (^)) , 

with high probability. This estimate is sharp up to absolute constants. 

Furthermore, we provide applications of this result to the Restricted Isom- 
etry Property (RIP) of a matrix with independent isotropic log-concave un- 
conditional random rows. We give sharp estimate for the restricted isometry 
constant of such matrices. 

It is well known and follows from Talagrand's majorizing measure theo- 
rem (see [11]) that if X = (Xi, . . . ,Xrf) is a centered sub-gaussian random 
vector in W^ with parameter a > 0, that is, all coordinates Xi are centered 
and for any a; G M*^ of Euclidean norm 1, any t > 0, P(| ^XjXj| > t) < 
2exp(— t^/a^), then for any norm || ■ || on M'^, one has 

E||X|| < CaE||r||, (3) 

where Y = {gi, . . . ,ga) and C > is an absolute constant. 



It is interesting to view both inequalities ([2]) and (E]) in parallel. There 
are both based on majorizing measure theorems of Talagrand; inequality ([3]) 
states that the expectation of the norm of a sub-gaussian vector is up to a 
multiplicative constant, dominated by its Gaussian replica. So Gaussian vec- 
tors are almost maximizers. To which class of random vectors does inequality 
([2]) correspond? Since in many geometric and probabilistic inequalities in- 
volving isotropic log-concave vectors, Gaussian and exponential vectors are 
the extreme cases, it was naturally conjectured that the expectation of the 
norm of isotropic log-concave vector is similarly dominated by the corre- 
sponding expectation of the norm of an exponential random vector. This 
conjecture would have many applications. For instance the estimate of F^ ^ 
above would extend to general log-concave random matrices, which is open 
(see tlj). 

We show that this is not the case. Namely, in Theorem 15. II we prove that 
for any d > 1, there exists an isotropic log-concave random vector X G M*^ 
and a norm || ■ || on M°' such that 

E\\X\\>cVh[dE\\Yl (4) 

where Y is of "symmetric exponential" type and c is a positive universal 
constant. Similarly we show that our Chevet inequality does not extend to 
the setting of general log-concave random matrices (non unconditional). In 
fact it would be interesting to find the best dependence on the dimension in 
the reverse inequality to (j4]). More precisely, to solve the following problem. 

Problem. Find tight (in terms of dimension d) estimates for the following 
quantity 

„.. EIIXII 

G [dj = sup sup 



X 



E Y 



where Y = {Ei, . . . , Ed) and the supremum is taken over all norms || ■ || on 
W^ and all isotropic log-concave random vectors X &W^. 

Theorem 15.11 and Remark 2 following it show that c vmrf < C{d) < C\fd 
for some absolute positive constants c and C . 

The results on norms of submatrices and applications were partially an- 
nounced in [2]. For the related estimates in the non- unconditional case, see 

[I]- 

The paper is organized as follows. In the next section we introduce nota- 
tion and quote known results which will be used in the sequel. In Section Owe 



prove the Chevet type inequality (and corresponding probability estimates) 
for unconditional log-concave matrices. In remarks we discuss its sharpness 
showing that in general one can't expect the lower bound of the same order 
and providing a relevant lower bound. In Section H] we apply our Chevet type 
inequality to obtain sharp uniform estimates for norms of submatrices. Then 
we apply the results to the RIP. Section E] is devoted to examples showing 
that one can't drop the condition of unconditionality in the comparison the- 
orem of the second named author and in our Chevet type inequality. Finally, 
in Section |6l we present a direct approach to uniform estimates of norms of 
submatrices, which does not involve Chevet type inequalities and 7p func- 
tional, but is based only on tail estimates for suprema of linear combinations 
of independent exponential variables and on a chaining argument in spirit of 

m- 
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2 Notation and Preliminaries 

By I ■ I and (■, ■) we denote the canonical Euclidean norm and the canonical 
inner product on Mf^. The canonical basis of M.'^ is denoted by ei, . . . , e^. 
As usual, II ■ lip, 1 < p < oo, denotes the £p-norm, i.e. for every x = 

i/p 



y \xif j for p < oo and 



Flip ~ 7 F«r tor p < oo ana ||x||oo = sup \Xi\ 

.1^1 J ^^^ 

and ip = (M'^, || ■ ||p). The unit ball of i^ is denoted by B^. For a non-empty 
set T C M"' we write diamp(T) to denote the diameter of T with respect to 
the £p-norm. 

For an origin symmetric convex body K C W^, the Minkowski functional 
of K is 

||x||^ = inf{A > I X G XK}, 



i.e. the norm, whose unit ball is K. The polar of K is 

K° = {x\ {x, y) < 1 for all y G K}. 

Note that K° is the unit ball of the space dual to (M*^, || ■ H;^). 

Given an n x A^ matrix V and origin symmetric convex bodies K C M^, 
L C M" we denote by 

||r: K ^ L\\ 

the operator norm of F from (M^, || ■ ||^) to (M", || ■ \\j^. We also denote 



R{K) = ||Id : K ^ B^^W, R{L°) = ||Id : fi^ -^ L\\ = ||Id : L° ^ B. 
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where Id denotes the formal identity M^ — )■ M^ or M" — )> M". 

Given a subset i^ C M*^ the convex hull of K is denoted by conv(i^). 

A random vector X = (Xi, . . . ,Xjv) is called unconditional if for every 
sequence of signs ei, . . . , En, the law of (^iXi, . . . , enXn) is the same as the 
law of X. 

A random vector X in M" is called isotropic if 

E{X,y)=0, E\{X,y)\'=\\y\\l for all y G M^ 

in other words, if X is centered and its covariance matrix EX (g) X is the 
identity. 

A random vector X in M" with full dimensional support is called log- 
concave if it has a log-concave density. Notice that all isotropic vectors have 
full dimensional support. 

By Ei, Eij we denote independent symmetric exponential random vari- 
ables with variance 1 (i.e. with the density 2~-'^/^exp(— v^ \x\)). By gi, gij 
we denote standard independent A/'(0, 1) Gaussian random variables. The 
nx N random matrix with entries gij will be called the Gaussian matrix, the 
nx N random matrix with entries Eij will be called the exponential random 
matrix. Similarly, the vectors G = {gi, . . . ,gd) and Y = {Ei, . . . , Ea) are 
called Gaussian and exponential random vectors. 

In the sequel we often consider n x N matrices as vectors in W^ with 
d = nN and the inner product defined by 



{A,B) = Y,avk 



*.j 




for A = (aij), B = {hij). Clearly, the corresponding Euclidean structure is 
given by Hilbert- Schmidt norm of a matrix: 



1^1 



In this notation we have ||^||oo = maxj j \aij\. We say that such a matrix A is 
isotropic/log-concave/unconditional if it is isotropic/log-concave/unconditional 
as a vector in R'^, d = nN (cf. the definition given in the introduction). 

Given x G M^ and y & M."', denote hj x ^ y = yx~^ the matrix {yiXj}ij, 
i.e. the matrix corresponding to the linear operator defined by 

X ^ y (z) = {z,x)y. 

Then, for an n x A^ matrix F = (7jj), 

\\T : K -^ L\\ = sup sup y^'JijXjyi = sup(r,a; ® y), 

where the latter supremum is taken over 

T = K®L° = {x®y : x e K, y e L°}. 

We will use the letters C, Co, Ci, . . ., c, cq, ci, . . . to denote positive abso- 
lute constants whose values may differ at each occurrence. We also use the 
notation F ^ G ii there are two positive absolute constants C and c such 
that cG< F <CG. 

Now we state some results which will be used in the sequel. We start 
with the following lemma, which provides asymptotically sharp bounds on 
the norm of the exponential matrix considered as an operator (i^ —)■£". We 
will use it in our examples on sharpness of some estimates. 

Lemma 2.1. Let T = {Eij)i<^n,j<N- Then 

E ||r : ^i -^tlW ^n + \nN. 

Proof. First note 



F : £f ^£^||=ma^J]|E,,|. (5) 



i<N 



By the Chebyshev inequality for every i < n we have 

for some absolute constant C > 0. Hence the union bound and integration 
by parts gives 

E ||r : ii ^iiW <C{n + \nN). 

On the other hand, by ([5]) 

n 

E||r : e^ ^£'^\\>Ej2\Eij\=n/V2 

i=i 

and 

Ellr : ^f ^Cll >Emax|Eii| ^ 1 + lnA^ 

i<N 

(the last equivalence is well-known and follows from direct computations). 
This completes the proof. D 

The next theorem is a comparison theorem from [8]. 

Theorem 2.2. Let X be an isotropic log-concave unconditional random vec- 
tor in R"' and Y = {Ei, . . . , Ed) be an exponential random vector. Let \\ ■ \\ 
be a norm on Mf^. Then 

E\\X\\ <CE\\Yl 

where C is an absolute positive constant. Moreover, for every t > 1, 

P(||^|| >t) <cp(||r|| >t/c). 

Remark. The condition "X is unconditional" cannot be omitted in Theo- 
rem 12.21 We show an example proving that in Section |5l 

We will also use two Talagrand's results on behavior of random processes. 
The first one characterizes suprema of Gaussian and exponential processes 
in terms of the 7^ functionals. 

For a metric space {E, p) and g > we define the 7^ functional as 

00 
7g(E,p)= inf sup V2"/'' dist(a;,A,), 

8 



where the infimum is taken over all sequences {As)'^^ of subsets of E, such 
that l^ol = 1 and \A,\ < 2^" for s > 1. 

The following theorem combines Theorems 2.1.1 and 5.2.7 in [14 

Theorem 2.3. Let T C M'^ and pq denote the ig metric. Then 



Esup^Zififi f« 72(T,p2) and Esup y^ ZjEj ?^ 72(T, P2) + 71 (^^ P. 



2eT 



i=l 



zGT 



i=l 



We will also use Talagrand's result on the deviation of supremum of ex- 
ponential processes from their averages. It follows by Talagrand's two level 
concentration for product exponential measure (|12j). 

Theorem 2.4. Let T be a compact subset of'R'^. Then for any t > 0, 



P I sup 



y^^ZjEj 



> Esup 
zeT 



y^^ZjEj 



i=l 



t < exp 



-cmm 






where a = sup^g^i \z\, b = sup^g^- \\z\ 



3 Chevet type inequality 

Theorem 3.1. Let T be an isotropic log-concave unconditional random nxN 
matrix. Let K C MJ^ , L C M" be origin symmetric convex bodies. Then 



Elir -.K^Ll 



yNi 



<C I Wld: K^ B'^'W -E 



E^«' 



i=l 



\ld:B^^L\\ -E 



N 



E^- 



1=1 



K° 



Example. One of the most important examples of matrices satisfying the 
hypothesis of Theorem 13. II are matrices whose rows (or columns) are indepen- 
dent isotropic log-concave unconditional random vectors. Indeed, it is easy 
to see that ii X, Y are independent isotropic log-concave random vectors 
then so is {X, Y). If X, Y are in addition unconditional then clearly {X, Y) 
is unconditional. Therefore, if rows (or columns) of a matrix F are indepen- 
dent isotropic log-concave random vectors then F is isotropic log-concave. If 



rows (resp. columns) are in addition unconditional, then so is F. We will use 
it in Section m 

Remarks. 1. In fact in the Gaussian case the equivalence holds in the 
Chevet inequality. However, in the log-concave case one cannot hope for the 
reverse inequality even in the case of exponential matrix and unconditional 
convex bodies K, L. Indeed, consider the matrix F = {Eij) as an operator 
£f -^ £^ i.e. K = 5f , L = E^ By Lemma O 

E||F : ii ^iiW ^n + \nN. 

On the other hand, the right hand side term in Theorem 13.11 is 



C E^l^il + ^/nEmax\Ei\ ] ^ n + ^/n ln(2iV). 

Thus, if A^ > e" then the ratio between the right hand side and the left hand 
side is of the order -y/n. 

2. The following weak form of a reverse inequality holds for the exponential 
matrix F = {Eij)i<„j<N- 



EIIF : K ^ L\\> -\ max ||eJ;^o ■ E 

" 2 \ i<N 



Y.E, 



4 = 1 



+ max IIcjIIl ■ E 



N 



E^. 



j=l 



Ell^^i. 



\K° 



eII^e, 



e,; 



i<n 



i<n 



This shows that 



EllF : K ^ L\\ > max ||ej||/^o E 

i<N 



i<n 



and by duality we have 



E\\T -.K -^ L\ 



E\\r : L° ^ K°\\ >max||e,||L E 

i<n 



i<N 



K° 



K° 



Indeed, fix 1 < £ < A^ and take x E K such that ||ef||/^° = \{ei,x)\ = \xi\. 
Then 

E||F : i\:^L|| > EIIFxIIl = e|| Y^ EijXje,\\ yEll^EaXeei 

i<n,j<N i<n 
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3. As in Theorem l2.2[ the condition 'T is unconditional" cannot be omitted 
in Theorem 13.11 We show an example proving that in Section O 

Proof of Theorem 13.11 First note that considering the matrix F as a 
vector in M"^ and applying Theorem [221 we obtain that it is enough to prove 
Theorem 13.11 for the case of the exponential matrix. 

From now we assume that F = (Eij). Denote as before T = K ® L° = 
{x ®y : X & K, y ^ L°}. Then by Theorem 12.31 

E||F : K ^ L\\ = Esup sup y^^ij^jVi = Esup(F, x®?/) ^ 72(T, p2)+7i(7', Pc 

xeK yeL° '" 



»J 



and 



E 


n 

> \Eiei 

i=l 


E 


N 



l2{L°,p2) +7l(^°,Pc 



72(^,P2) +7l(^,Pc 



K° 



Thus it is enough to show that 

72(T,P2) < C(i?(ir)72(L°,p2) + i?(^°)72(i^,P2)) 

and 

71 (T, Poo) < C iR{Kh,{L°, p^) + i?(L°)7i(ir, p^)) 



(6) 



(7) 



Inequality (Q is the Chevet inequality for the Gaussian case. Indeed by 
Theorem E31 



72 



(T, P2) ?^ E sup ^ Zijgij = E|| (gy) : K -^ L\ 



zdT 



«,J 



and 



N 



R{Kh2{L°, p2)+R{L°h2{K, P2) ^ R{K)E sup ^ z,g,+R{L°)E sup ^ z,g,. 



z€L° 



i=l 



zeK 



i=l 



In fact we could prove IQ without the use of the Chevet inequality, but by 
the chaining argument similar to the one used for the proof of ([7]) below (cf. 
also [lOj). 

It remains to prove inequality ([7]). 



11 



Let As C K and Bs C L°, s > 0, be admissible sequences of sets (i.e., 
with \Aq\ = \Bq\ = 1, \As\, \Bs\ < 2^" for s > 1). Define an admissible 
sequence {Cs)s>q by Co = {0} and 

Cs = As-i® Bs-iC K ®L°, s>l. 

Note that for all x,x & K and for all y,y E L° one has 

\\x (S) y - X ^ y\\^ < Halloo ■ ||y-y||oo + ||y||oo ■ ||a; -5||oo 
<R{K)\\y-y\\^ + R{L°)\\x-x\\^. 

Therefore 



7i(ir®L°,poo) < sup V 2Mist (x ® y, C, 



<i?(ir) sup llylloo + Y^ 2Mist (y, 5, 



s-i 



j/Gi 



s=l 



+ i?(L°) sup I ||x||oo + ^2Mist(x,A 



s-ly 



xGii: 



Taking the infimum over all admissible sequences {Ag) and {Bg) we get 

7i(ir®L°,poo) 

< R{K) (diamooL° + 27i(L°, p^)) + i?(L°) (diamooi^ + 2^^{K, p^)) 

< 4R{K)^i{L°, Poo) + 4/?(L°)7i(ir, p^o), 

where in the last inequality we used the fact that the diameter is clearly 
dominated by doubled 71 functional. D 

Corollary 3.2. Let T, K , L he as in Theorem \3.1\ Then for every t > 0, 



Y.^- 



i=l 



+ R{L°) ■ E 



\\T:K^L\\ <C\R{K)-¥. 

with probability at least 

1 — exp j — c min 
where a = R{K)R{L°) and a' = sup^g^ II^^Hoo ^'^PyeL° Wv 



N 



Y,E, 



i=l 



+ t 



K° 



t^ t 



, , > 1 - exp -c min , 



t" t 
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Proof. As in the proof of Theorem 13.11 it is enough to consider the case 
r = (Eij). Moreover it suffices to show that 

T : K ^ L\\> E||r : K ^ L\\+t) < exp ( -cminJ— , — I J . 

To obtain the above estimate we use Theorem 12.41 Recall that ||r : i^ — >■ 
L\\ = supj.(r,x y), where T = K ® L° . Thus we can easily compute 
parameters a and h in Theorem 12. 4t 



and 



a = sup \x Q<)y\ = sup |a;| ■ \y\ = a 

T xeK, y&L° 



6 = SUp||x(g)?/||oo = sup ||x||oo ■ ||y||oo = 0^'- 

T x&K, y&L° 



n 



4 Norms of submatrices and RIP 

Here we estimate the norms of submatrices of an isotropic unconditional 
log-concave random n x N matrix F. 

Recall that for subsets J C {1, . . . , n} and / C {1, . . . , A^}, T{J, I) denotes 
the submatrix of F consisting of the rows indexed by elements from J and 
the columns indexed by elements from /. Recall also that for k < n and 
m < N, Tk^jji is defined by 

Ffc,^ = sup||F(J,/) : C^4||, (8) 

where the supremum is taken over all subsets J C {l,...,n} and / C 
{1,...,A^} with cardinalities \J\ = k,\I\ = m. That is, F^^^ is the max- 
imal operator norm of a submatrix of F with k rows and m columns. 

We also denote the set of ^-sparse unit vectors on M'^ by Ui (or Ui{d), 
when we want to emphasize the dimension of the underlying space) and its 
convex hull by Ui, i.e. 

Ue = Ui{d) = {x eM.'^: |suppx| < i and |x| = 1}, and Ug = conv^Ug). 

Thus 



k,m 



F : UraiN) -^ {Ukin)y 
13 



Note that (Ukin))" = {Ukin))°. Below U^ means (t/^)°. 

Remark. For matrices with A^ independent log-concave columns and k = n 
the sharp estimates for Tn,m were obtained in [3]. 

To treat the general case we will need the following simple lemma. 
Lemma 4.1. For any 1 < i < n we have 



E 



Ee. 



i=l 



V£ln^. 



Proof. By Borell's lemma ([5j) we have 



E 



n 


\ 


^E 


n 


1=1 


u°J 




i=l 



E sup ^Ef = ^E|E^ 



u? 



/C{l....,n} ■^ 



*|2 

i I 5 



\I\=l 



iai 



i=l 



! \En\ 



where E^, . . . ,E^ denotes the nonincreasing rearrangement of \Ei\ 

We conclude the proof by the standard well known estimate E|ii^*p ^ {ln{3n/i)Y 

n 



Now observe that F satisfies the hypothesis of Theorem 13.11 and that 
Ifi C B2, so R{Ue) = 1. Thus Theorem 13.11 implies 



EF, „, < C E 



N 




n 


J^^^e^ 


+ E 


^ EiCi 


1=1 


u° 


i=i 



which together with Lemma 14.11 and Corollary 13.21 implies the following the- 
orem. 

Theorem 4.2. There are absolute positive constants C and c such that the 
following holds. Let m < N and k < n. Let F be an isotropic unconditional 
log-concave random n x N matrix. Then 

(3N 3n 

^/^ In + Vk In — 
m k 

Moreover, for every t > 0, 

^km<C [^ In + y/k In-^ + t) 

\ m k J 
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with probability at least 

1 — exp (— cmin |t, t^}) . 

Remarks. 1. In the case when F = (Eij) we have 



N 



> max I e\\ y^ EiCi ,E||V^i. 

> — \/m m h V A; In -- . 

C \ m k J 



2. Theorem 14.21 can be proved directly (i.e. without Chevet inequahty) 
using a chaining argument in the spirit of [3]. We provide the details in 
the last section. Similar estimates (with worse probability) were recently 
independently obtained in [9]. 

We now estimate the restricted isometry constant (RIC) of a random 
matrix F with independent unconditional isotropic log-concave rows. As was 
mentioned in the example following Theorem 13.11 such F is unconditional 
isotropic log-concave. Recall that the RIC of order m is the smallest number 
5 = SmiX) such that 

(l-(5)|xp< |Fx|2< {l + 6)\x\\ 

for every x G Um- 

The following theorem is an "unconditional" counterpart of Theorem 6.4 
from [T] (see also Theorem 7 in [2]). Its proof repeats the lines of the corre- 
sponding proof in [T] . The result is sharp up to absolute constants. 

Theorem 4.3. Let < 6 < 1. Let F be an n x N random matrix, whose rows 
are independent unconditional isotropic log- concave vectors in M^. Then 
6m{^/V^) ^ ^ '"^^^^ probability at least 

1 — exp — c — 5 — — 2 exp — c y/m m 

\ In n/ \ m 



provided that either 
(i) N < n and 



m ~ mm < JM, — tt — rr )■ 
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or 

(a) N > n and 

6n . r 1 e \ 

- ln(3iV/(0n)) \ ln(3iV/(0n)) ' 111^(3/^) J ' 

where c > is an absolute constant. 

Remarks. 1. The condition on m in (ii) can be written as follows 

, , ln2ln(3A^/n) , On 

a e> , , \,,\ ' then m<c 



ln(3Ar/n) " \n\?,N/{en)y 

, ^ In^ ln(3A^/n) , 9'^ n 

ii 9 < , , \,,\ ' then m<c 



ln(3iV/n) "^^" ■■^-^ln'(3/^) ln(3Ar/(^n))" 

2. Precisely the proof of Theorem 6.4 in [1] (with estimates from our 
Theorem I4.2p gives that if 

/ 3A^\ ^ 

bm '■= rn { In ) < c9n 

\ m J 

and 

, 3A^ , 2 ^ n2 

m In In - — < c9 n 

m bm 

then Sm(r/y/n) < 9 with probability at least 

/ 9^n \ f ^ ^ 3N\ 
1 — exp — c — TT, — ; — - — 2 exp — c \/m In . 

5 An example 

In this section we prove that the condition "X is unconditional" cannot be 
omitted in Theorems 12.21 and 13.11 Namely, first we construct an example 
of isotropic log-concave non-unconditional (i- dimensional random vector X 
and a norm || ■ || on M'^, which fails to satisfy the conclusion of Theorem 12.21 
Then we consider the matrix consisting of one column X as an operator 
from (M, I ■ I) to (M°', || ■ ||) and show that it does not satisfy the Chevet type 
inequality. The idea of the construction of X is rather simple - we start with 
a matrix with i.i.d. exponential entries and rotate its columns by a "random" 
rotation. Considering the matrix as a vector with operator norm ii — )■ ii we 
prove the result. 
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Theorem 5.1. Let d > 1 and Y = {Ei, . . . ,£'d). There exists an isotropic 
log- concave random vector X in W^ and a norm || ■ || such that 



E\\X\\ >c Vh[dE\\Y\ 



(9) 



where c > is an absolute constant. Moreover, the d x 1 matrix B, whose 
the only column is X , satisfies 



m\B 



-1,1] ^ L\\>c VW E 



E^. 



i=l 



|Id : B^^ L\ 



where L is the unit ball of || • ||. 

Proof. Let n, N be integers such that d = nN. Consider an n x A^ matrix 
r = (Eij). Denote its columns by Xi, . . . , X^v, so that T = [Xi, . . . , Xj^]. As 
before, we consider F as a (i-dimensional vector. Given U G 0{n) rotate the 
columns of F by [/: 



A = A{U) =UT = [t/Xi, ...,UX^ 



N 



Then A is a log-concave isotropic vector in M.'^. Below we show that if X = 
[e'^"-\ for some absolute constant c > then there exists Uq G 0{n) such that 



Er \\A{Uo) 



„N 



-)■ 



r^W > CiVW Er ||F : i{ 



N 



-)■ 



(10) 



This will prove the first part of the theorem, since it is clearly enough to 
consider only such n, X, d by adjusting the constant in the main statement. 
To prove (TTO!) we estimate the average of ||A(f/)|| over U G 0{n). For 
every x in M" we have 

^^oin) ({||f^a;||i > C2^/n \\x\\2]) =o-„_i({y: ||y||i > C2^/n}) > l-exp(-2cn), 

where cr„_i denotes the uniform distribution on S"'~^ and the last inequality 
follows by simple volumetric argument (or by concentration, see e.g. 2.3, 5.1 
and 5.3 in [Uj). Thus, if X < e'=", 

1 



^o(n) ({V« < X : \\UX,\\^ > C2v^ WXih}) > 1 - exp(-cn) > 



Hence 



Eotn) niaxllf/XJIi > C2\fn maxllXjIU, 

^ ' i<N i<N 
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which imphes 

Er Eo(„) \\A{U) : £f -^ £^|| > Cav^ Er max \\Xi 



i<N 

> C2 y/n Er max lEn] > c^ \fn In A^. 

i<N 



By Lemma [2.11 



n In A^ r r — - 

> C4 ; — — > CsvlnA/ > cevma. 

n + m A* 



Er ||r : ^f ^£"11 ^n + lniV, 
Thus, taking A^ = [e™J , 

Eo(„)Er P(?7) : £f -> ^^ 
Er ||r : £f ^£','11 

Hence there exists f/o ^ 0{n) satisfying ( ITOl) . 

Now we will prove the "moreover" part of the theorem. Recall that L 
is the unit ball of the norm || ■ || constructed above. The log-concave vec- 
tor under consideration is X = A{Uo) and the matrix which provides the 
counterexample to the Chevet type inequality is -B = [X]. By the above 
calculations we have 



E\\B : [-1, 1] -^ L\\ = E\\X\\l = Ep(L/'o) : ff -^ f" || > c (Inrf) 



\3/2 



and 



E 



E^.< 



i=l 



E||r : t^ ^i'lW^n + lnN ^Ind. 



It is easy to check that for every n x N matrix T = (tjj) one has 

n / n n 

\\T : £f ^£^1 
where ^/n is the best possible constant in the inequality. This shows that 



n Inn 



1/2 



lid : 5^ ^ L|| = v^ ^ Vind. 



Thus 



E 



^Y^Eiti 



i=\ 



|Id: S^^LII ?«lnd, 
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which completes the proof. D 

Concluding remarks. 1. The above example is optimal in the sense that 
one can't expect better than y/lad dependence on dimension in Qj. Indeed, 

let Y = {El, . . . , Ed). We show that for any U G 0{d) and any norm || ■ || on 
Mf^ one has 

E\\UY\\ < C^/\og{ed) E\\Y\\. (11) 

First it is known that E||r|| < C^log(erf) E||G||, where G = {gi,...,gd). 
Now note that if if is a unit ball of || ■ \\k then for every U & 0{d) one has 
||f^2:||ft: = ||x||[/-i7^ for every x G M'^. Therefore, for any U G 0{d) we have 



E\\UY\\ < C^/\og{ed) E\\UG\\ = C^/log{ed) E\\G\\ 

(in the last equality we used that the distribution of G is invariant under 
rotations). Finally note that by either Theorem 12.31 or Theorem 12.21 the 
norm of an exponential random vector dominates the norm of the Gaussian 
one, i.e. EUGH < CiE||F||, which implies f lTT]) . 

2. For any isotropic vector X in M"^ (not necessarily log-concave) and any 
origin symmetric convex body if C M'^ we show that 

E||X||x < Gd{K, B^) E||r lli^, (12) 

where Y = {Ei, . . . ,Ed) and (i(if , i?|) denotes the Banach-Mazur distance 
between K and i?|. Since for every origin symmetric K one has d{K, i?|) < 
vd (see e.g. [I5]), the inequality flT2|) implies that for any norm || ■ || on W^ 

E\\X\\ < Cv^E||r||. 

Now we prove (fT2l) . First, as in Remark 1, note that the norm of an ex- 
ponential random vector dominates the norm of the Gaussian one. Thus 
it is enough to show that E||X||;^ < Cd{K,B2) K\\G\\k, where G is as in 
Remark 1. Let a = d{K, Bf) and £ be an ellipsoid such that £ G K G aS. 
Since this is only a matter of rotation of a coordinate system we may assume 
that S = {x eW^: X]i=i (^1^1 — !}• Then by the isotropicity of X, 

/ d \ 1/2 . d \ 1/2 

E\\X\\K<nx\\e = Elj2a',xn < (E^H < CE\\G\\e < CaEWGU, 

where we used comparison of the first and second moments of the norm \\G\\£: 
of the Gaussian vector. 
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6 A direct proof of Theorem 14.2 



We present here a proof of Theorem 14.21 not involving the Chevet type in- 
equahty and not relying on Theorem I2.3[ but only on tail estimates for 
suprema of linear combinations of independent exponential variables given 
in Theorem 12.41 

We need the following lemma, which is an immediate consequence of The- 
orem [2]1] (recall here that for a matrix A = [aij), ||A||oo denotes maxj.j \aij\)- 

Lemma 6.1. For every n x N matrix A = (aij) and every t > we have 

e t 



p 



HjO-ij 



where c > is an absolute constant. 



> t < 2exp — cmin 



|A|2' \\A\ 



Indeed, since E| ^.. Eijaij\ < (E| ^.. EijXijl'^Y^'^ = \A\, the above Lemma 
follows from Theorem 12.41 for t > 2\A\. For t < 2\A\ we can make the right 
hand side larger than 1 by the choice of c. 

Direct proof of Theorem 14.21 As in the proof of Theorem 13. ![ using 
Theorem 12. 2 [ we may assume that F is the exponential matrix, i.e. F = (Eij). 
Without loss of generality we assume that k > m and that k = 2*" — 1, 
m = 2** — 1 for some positive integers r > s. It is known (and easy to see 
by volumetric argument) that for any origin symmetric convex body l^ C M*^ 
and any e < 1 there exist an e-net (with respect to the metric defined by 
V) in V of cardinality at most (3/e)'^. For i = 0, 1, . . . ,r — 1 let Aii be a 
(2Y(4/i;))-net (with respect to the metric defined by i?2 ^ (2~*^^-BSd)) i^ the 
set 

U M^ n ^2™ n (2-^/2^^) 

IC{l,...,n} 

/|<2« 



of cardinality not greater than 

'n\/12A;\2' , /_,, /2n^ 
,2^ 



<exp(c2Uog(^)), 



where R^ denotes the span of {ejjjg/. Similarly for z = 0, 1, . . . , s — 1 let A/i 
be a (2Y(4m))-net in the set 



[j R^nB^n (2-^/^5 



7C{1,...,JV} 

/|<2» 
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of cardinality at most 

(2.)(— ) £-p(«''°s(^))- 



Let now Ai be the set of vectors in 2i?2 that can be represented in the 



form X = J2lZo ^iy where Xi G A^j and have pairwise disjoint supports. 
Analogously define A^ as the set of vectors y = J2iZo Vi ^ 2-B^, with yi G Afi 
and pairwise disjoint supports. For x E AA and i = 0, 1, . . . , r — 1 let SiX = 
Xq + . . .+Xi, where Xi is the appropriate vector from the above representation 
(this representation needs not be unique, so for each vector x we choose one 
of them). Similarly, for i = 0, 1, . . . , s — 1 and y G A^ let Tiy = y^ + . . . + yi. 
For i = s, . . . , r — 1 let T^y = y. Additionally set S-ix = 0, T_iy = 0. We 
thus have 

r-l 

y®x = "^{Tiy (g) SiX - Ti_iy ® Si-ix) 

i=0 

for X G M,y G A/". 

Since Xj's and yj's have pairwise disjoint supports, viewing {Tjy SjxYs 
as sub-matrices of y ® x, it is easy to check that for every j > i 

\Tjy (g) SjX - Ti^iy ® Si-ix\ < 4 (13) 

and 

\\Tjy ® SjX - T,_iy ® S-.-ixlloo < 2-'l\ (14) 

Thus, by Lemma 16.11 for any a; G Al, y G A/" and t > 1, 

¥{\{VTiy,Six) - {VTi^^y,Si^ix)\ >t)< 2exp(-cmin(t^ 2^/2t)). (15) 

Moreover, for any i < s — 1, the cardinality of the set of vectors of the 
form Tiy (g) SiX — Tj_iy (g) Si-^ix, x E Ai,y E Af is at most 



exp (t («^log (|)+«^log (f ))) < exp (<?2Mog (|)+<?2-log (§ 



By (1151) and the union bound we get that for z < s — 1 and any t > 1, 
with probability at least 



2 exp ( -ct{ T \ogi2n/2') + 2' log(2A^/2* 
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one has 

max \{TTiy,S,x)-{TT,_^y,S,.ix)\<Ct(T/Hog{2n/T)+T'Hog{2N/T 

xGM,y£Af \ 

By integration this yields 

E max \{TT,y,S,x)-{TTi,,y,S,.ix)\<c(T/^\og{2n/T)+T/^\og{2N/T 
xeM,yeM \ 

Therefore 

s-l 



E sup I {TTs-iy, Ss-ix) | < V] E sup | {TTiy, Six) - {TTi^iy, Si-ix) \ 

x&M,y&N ^^Q x€M,y€J\f 

s-l 

<J2^ (2'^^ log(2n/2*) + 2*/2 log(2Ar/2* 

i=0 

< Ci ('v^log(2n/A;) + ^/^\og{2N/m)^ . (16) 

On the other hand, for any y E M and i > s, we have by Ti^iy = Xiy = y. 
Thus by ( IT5|) and the fact that there are at most exp(C2*log(2n/2*)) vectors 
of the form SiX — Si-iX with x G A^, we get for t > 1, 

sup \{TT,y, {SiX - Si.,x))\ < CtT/Hogi2n/T), 
xeM 

with probabihty at least 1 — exp(— ct2* log(2n/2*)). 
This implies that for s < i < r — 1, 

Emax\{TT^y,S^x) - {TT^^iy, Si^^x)] < CT/Hogi2n/T) 
xeM 



and thus 



Emax |(rTr_i?/, Sr~ix) - {TTs-iy, S^-ix) 

x£M 



< '^ E max I {TTiy, Six) - {Ti^iTy, Si^ix) \ 

i=s 
r~l 

< C ^ 2*/2 log(2n/2^) < C'v^log(2n/A;). 
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Applying Theorem 12.41 together with (IT^ and (1141) (with j = r — 1 and 
i = s) we obtain that for any y & M and t > 1, 

max |(rr,_iy, Sr-ix)-{VT,_^y, Ss-ix)\ < CVklog{2n/k)+Ct2'/Hog(2N/2'). 

with probabihty at least 

1 -2exp{-Ct2'\og{2N/2')), 
which by the union bound and integration by parts gives 
E max I {Tr-iy, ASr-ix) - {T^-iy, ASs-ix) \ 

x<^M,yeJV 



m, 



< CVk\og{2n/k) + C2'/Hog{2N/2') < c(Vk\og{2n/k) + ^\og{2N/ 

Combining this inequality with (fT6|l we get 

E max \{y,Ax)\ <c(Vk\og{2n/k) + ^/m\og{2N/m 
xeM,yeJ^ \ 

Let us now notice that for arbitrary x G 5*""^, y G S'"'^'^, with |suppx| < 
fc, Isuppyl < m, there exist x G Ai,y G Af, such that suppx C suppx, 
supp y C supp y and 



r— 1 s—1 



\x — xl^ 



< J2 2'7(16A;2) < 1/8, \y-y\^ <J2 2'V(16m2) < 1/8. 



1=0 i=0 

We have 

{Ty, x) = {Ty, x) + {V{y -y),x) + {Ty, x-x). 
Taking into account that y G 25^ and passing to suprema, we get 



^k,m < max {ry,x) + 3rfe,m/8 

x£M,y£M 



and thus 



EFfc „ < 2E max {Ty, x) < C{^\og{2n/k) + v^log(2A^/m)), 

which completes the proof of the first part of Theorem 14.21 The proof of the 
"moreover" part is obtained using Theorem 12.41 in the same way as it was 
used to obtain Corollary 13.21 from Theorem 13.11 D 
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Remark. We would like to notice that by adjusting the chaining argument 
presented above one can eliminate the use of the full strength of Theorem 12.41 
and obtain a proof relying only on tail inequalities for linear combinations 
of independent exponential random variables (which follow from classical 
Bernstein inequalities). The modification involves splitting the proof into two 
cases depending on the comparison between mlog(2A^/m) and klog{2n/k). 
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